Unconstrained face sketch synthesis via perception-adaptive network and a new benchmark
نویسندگان
چکیده
Face sketch generation has attracted much attention in the field of visual computing. However, existing methods either are limited to constrained conditions or heavily rely on various preprocessing steps deal with in-the-wild cases. In this paper, we argue that accurately perceiving facial region and components is crucial for unconstrained synthesis. To end, propose a novel Perception-Adaptive Network (PANet), which can generate high-quality face sketches under an end-to-end scheme. Specifically, our PANet composed of: i) Fully Convolutional Encoder hierarchical feature extraction, ii) Face-Adaptive Perceiving Decoder extracting potential handling variations, iii) Component-Adaptive Module component aware representation learning. facilitate further researches synthesis, introduce new benchmark termed WildSketch, contains 800 pairs photo-sketch large variations pose, expression, ethnic origin, background, illumination. Extensive experiments demonstrate proposed method capable achieving state-of-the-art performance both conditions. Our source codes WildSketch resealed project page http://lingboliu.com/unconstrained_face_sketch.html.
منابع مشابه
Face Photo Sketch Synthesis via Larger Patch and Multiresolution Spline
Face photo sketch synthesis has got some researchers' attention in recent years because of its potential applications in digital entertainment and law enforcement. Some patches based methods have been proposed to solve this problem. These methods usually focus more on how to get a sketch patch for a given photo patch than how to blend these generated patches. However, without appropriately blen...
متن کاملFace Sketch Synthesis and Recognition
In this paper, we propose a novel face photo retrieval system using sketch drawings. By transforming a photo image into a sketch, we reduce the difference between photo and sketch significantly, thus allow effective matching between the two. To improve the synthesis performance, we separate shape and texture information in a face photo, and conduct transformation on them respectively. Finally a...
متن کاملFace Sketch Synthesis: A Neural Style Approach
Face sketch synthesis plays a significant role in the domain of face recognition and retrieval applications. Great interest of its applications in law enforcement and entertainment have continued to be noted in the research community. Over the years, great advances have been noted in face sketch synthesis as most recent methods are gradually moving towards deep representation based approaches. ...
متن کاملLighting and Pose Robust Face Sketch Synthesis
Automatic face sketch synthesis has important applications in law enforcement and digital entertainment. Although great progress has been made in recent years, previous methods only work under well controlled conditions and often fail when there are variations of lighting and pose. In this paper, we propose a robust algorithm for synthesizing a face sketch from a face photo taken under a differ...
متن کاملFast Preprocessing for Robust Face Sketch Synthesis
Exemplar-based face sketch synthesis methods usually meet the challenging problem that input photos are captured in different lighting conditions from training photos. The critical step causing the failure is the search of similar patch candidates for an input photo patch. Conventional illumination invariant patch distances are adopted rather than directly relying on pixel intensity difference,...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2022
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2022.04.077